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also derive the integer-spin equivalent of the de Almeida- Thouless line. 
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1. Introduction 

The circumstance that two statistical ensembles lead to different results for some 
systems, called ensemble inequivalence, is one of the most perplexing phenomena in 
statistical physics. It was known for gravitational systems [H EJ El HJ [5] long before 
the application to spin systems ten years ago [6]. The re-discovery of ensemble 
inequivalence sparked renewed interest and brought about many studies (for reviews 
see [3 EJ El QUI EH] ) • A prominent feature of ensemble inequivalence is the emergence 
of negative specific heat in the microcanonical ensemble. In the canonical ensemble, 
specific heat is always positive, since the free energy is always a concave function. On 
the other hand, the microcanonical entropy as a function of the internal energy, around a 
first order transition can have a stable convex intruder [12]. Another feature of ensemble 
inequivalence is the occurrence of mixed phases in the microcanonical phase diagram, 
when the temperature and another, possibly external, control parameter are chosen as 
axes. This is the direct result of a convex intruder in the entropy as a function of energy, 
since then two distinct phases can exist at the same temperature. For more intriguing 
properties of this phenomenon we refer the reader to the literature, e.g. [7J. 

The best known occurrence of ensemble inequivalence is in long-range interacting 
systems which have a first-order phase transition [T3~l [HI [15] , but similar properties also 
occur in driven systems with local dynamics p2J [17]. An interaction is said to be of 
long range when it decays slower than l/r a , where r is the spatial distance between 
interacting objects and the value of a is smaller than the system's dimension, or when 
the system size is of comparable order as the range of the interaction. In long-range 
interacting systems, the energy is not additive, i.e. if two identical sub-systems with 
energy E are brought into contact, the total energy of the resulting system is not 2E, 
because interface interactions cannot be neglected. 

Such systems appear in virtually every branch of physics, from atomic physics 
P2] to spin systems [3 [191 1201 EEl Ml E3j [H] and gravitational systems (see [H] and 
references therein). Recently, the effect of randomness on ensemble inequivalence was 
investigated using many-body interacting spin models in [231 121] • So far, however, no 
inequivalence was found for the spin-glass (SG) transition. 

The results of the theory of SGs is of interest for many areas of science. Fields like 
statistical mechanics, information processing, image restoration and neural networks 
take advantage of the methods first used to describe SGs, see [251 EHl [27] and references 
therein. Therefore, it will be an important task to study how the ensemble inequivalence 
appears in SG systems. 

In this paper, we investigate a system which shows a first-order transition between 
paramagnetic and SG phases: the infinite-range, many-body SG model with integer 
spin, 5=1. This model is the mean-field variant of the Blume- Emery-Griffiths model 
[28] , which was introduced to describe mixtures of liquid He3-He4, but with quenched, 
random interactions. The case of random interactions was first studied for two-body 
interactions in [29] by using the simple replica symmetric ansatz. 
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Infinite-range models have the advantage that they are exact in the mean-field 
ansatz and thus yield valuable limiting cases of more realistic models. Apart from 
interest for investigations of ensemble inequivalence, our model is another example of the 
(admittedly, classical) Bose-glass phase, which appears in systems of Helium in porous 
media [30]. Moreover, taking the limit of infinitely many-body interactions yields for 
our model an analytically accessible scenario and a generalization of the random energy 
model (REM) [SI E3 ■ 

The organization of the paper is as follows. In section |2} we introduce the model 
under investigation, and state the results for the thermodynamical potentials. In 
section [31 we draw the analytically accessible phase diagram of the REM, corresponding 
to the limit of infinitely-many-body interactions. We also study three-body interacting 
case in section H] and p-body case with p > 3 in section [5j To clarify the analytical 
result at p — > oo, we investigate numerically how the infinite limit is attained. We 
conclude our investigations in section [6j In the appendices, we show some technical 
details of the calculations, in Appendix A we describe the derivation of the replicated 
thermodynamic potentials, while in Appendix B we derive the de Almeida-Thouless 
(AT) condition [351 EE] for the many-body integer-spin case. 



2. Model 



We investigate the properties of a system of N spins, where each spin can take the values 
+1,0, —1, and each interacts with every other spin through quenched, random p-body 
interactions. It is given by the Hamiltonian 

N 

H = - Jiii2~i p SiiSi 2 • ■ ■ $i P + D^2(Si) 2 - (!) 

£l<l2<"'<%> i=l 

The role of the external field is played by the so-called crystalline anisotropy, whose 
strength is measured by the parameter D. The interactions J^.-.i are quenched random 
numbers obeying the Gaussian probability distribution 

Prob(J n .., p ) = [—) exp {- — {Jn-i P Y) • (2) 

The limit D — > — oo corresponds to the Ising model, i.e. only the spin states Si — ±1 
contribute to the energy. 

The corresponding pure system, namely when the interactions are not random and 
are all equal, is known as the Blume- Emery- Griffiths model [28]. It was shown in [6] 
that the pure model with p = 2 exhibits ensemble inequivalence in the region of the 
first-order phase transition. For technical reasons, explained below, we will treat only 
the many-body interacting case with p > 2. 

Using the standard methods of replica theory (see e.g. [26]), we can calculate 
the thermodynamic potentials, the free energy in the canonical and the entropy in the 
microcanonical ensemble. We employ the one-step replica symmetry breaking (1RSB) 
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[37J ESI EH] ansatz for the SG order parameter. Here, we only give the results and the 



details are described in |Appendix A 



In the canonical ensemble, the free energy density is obtained as a function of the 
order parameters as 

1 — x 



(3 2 (3 2 
-^X P + XX + -£\ l -x)<f 

1 



-qq + (3Dx 



- - In 

x 



y Dz l + 2e*^ /2 cosh( v / ^) *} 



(3) 



while the entropy density in the microcanonical ensemble is from 



a 



X p - (1 - x)qP 

+ - In 

x 



XX + 



x 



-qq 



y Dz l + 2e^ /2 cosh(ygz) *} 



(4) 



where /3 = 1/T is the inverse temperature, e = E/N is the energy per spin and 
Dz = dzexp(—z 2 /2)/\/2n. The symbols Xi Q an d x are variables parametrizing the 
1RSB solution. Here, q is the spin glass order parameter, x is the quadrupole moment 
and x is the Parisi RSB parameter. The order parameters have the following physical 
meaning: 

ff=[<fl?flf>] and X = [((S?) 2 )], (5) 
where [. . .] and (...) represent the configurational and thermal average, respectively. 
Therefore, q can be thought to measure the correlation of spins in different replicas and 
X measures the fraction of spins in the Ising states 5j G ±1 within a single replica. The 
parameter x has no clear physical meaning, but can be thought to measure the degree 
of RSB in the system. 

The variables with the hat symbol, q and x, are the Fourier modes of q and 
X, respectively. The modes are related to the physical quantities through saddle- 

We can easily see that the generalized 



point equations specified in Appendix A 
thermodynamic potentials 
caloric relation 

2fe- 



> and a are formally related via 
Dx) 



f3e — a, when the 



X p - (1 - x)qP 
is used. 

The stable branches of the free energy are determined by the condition 
f{p) = minmax0(x,g,x,/3), 



q,x 



and of the entropy by 



s(e) = maxmin <j(y, q, x, e). 



These extremization conditions give the saddle-point equations 

2e *-9/2 cosh(v^z) 



X 



D'z 



D'z 



1 + 2e*-9/ 2 cos\i(y/qz) ' 
f 2e*-^ 2 sinh(Vgz) V 
[ 1 + 2e*-9/ 2 cosh(y/qz) J 



(6) 

(7) 
(8) 

(9) 
(10) 
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and 



~ "J 9 J x =x 



J D'z In (l + 2e*-« /2 cosh(yg^)^ (11) 
- In (J Dz 1 + 2e*^ /2 cosh(y^) , (12) 



where 



JDz\l + 2e*^/2 cos h(^)} X ' (• • •) 

D'z {••-) = - - v y J \ ' (13) 

/ Dz {l + 2e*-9/ 2 cosh(v^z)} X ' 

As stated, the saddle-point equations lead to multiple branches of a and 0, which all 
correspond to various stable, meta-stable and unstable phases. Ensemble inequivalence 
occurs when there is no one-to-one correspondence of the stability of the branches of 
the thermodynamic potentials. It may happen, for example, that a stable branch of the 
entropy corresponds to a meta-stable, or even unstable branch of the free energy. That is 
a macrostate realized in the microcanonical ensemble, might not exist in the canonical 
ensemble. This scenario appears, however, only for first-order phase transitions [7j, 
since at second-order transitions there are no meta-stable solutions of the saddle-point 
equations. 

The final remark to be made in this section is on the validity of the 1RSB ansatz. 
In the standard p-body Ising SG with Si = ±1, for p > 2 the replica-symmetric solution 
of the SG phase does not show up and the replica symmetry is already broken just below 
the SG transition temperature, justifying the IRSB-ansatz. At low temperatures, the 
1RSB solution becomes unstable and the SG phase is described by the full-step replica 
symmetry breaking solution [^0l Hi] . We expect that a similar scenario holds in the 
present integer-spin case. In the following, we will show that this is indeed the case. 
However, for p — 2, the SG phase is described by the full-step replica symmetry breaking 
solution and the 1RSB solution does not appear. That is the reason why we consider 
only p > 2. For a canonical analysis with p = 2, see [29|. 



3. Infinitely-many-body interactions (p — > oo) 

In the limit p = oo, our model (CQ) is the spin-1 equivalent of the REM [3T], [321 [33]. The 
saddle-point equations ([9]) and fTTUjl can be solved analytically and have three simple 
solutions. These yield three respective branches of the free energy and the entropy, 
which we identify as paramagnetic (P), Ising paramagnetic (IP), and SG phases. These 
phases are characterized through the order parameters as 

P: q = 0, X <h 
IP: q = 0, X = l, 
SG : q = l, X = l, 

in both ensembles. It is thus not a-priory clear where ensemble inequivalence should 
occur on the level of macrostates. The aims of the present section is to clarify this point. 
This will be done by comparing the canonical and microcanonical phase diagrams. 
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3.1. Canonical ensemble 

The saddle-point equations always allow the solution q = 0. In that case, we get a 
self-consistent equation for x as 



2exp(-f3D + £p X p - 1 ) 



X = v 1—1 L (14) 

l + 2exp(-f3D + ^ PX P- 1 ) 

In the limit p — > oo, there are two possibilities, x < 1 (x p ~~ 0) an d X = 1, corresponding 
to the P and IP phases respectively. 

In the P phase, the order parameter 

2e- f3D 

X = TT^> (15) 

corresponds to the fraction of spins that take the value ±1. The free energy in this 
phase is given by 

/ P = -iln(l + 2e-^). (16) 

In the IP phase, the zero-spin state plays no role and each spin takes the value ±1 only, 
so that x — 1- The free energy here is 

/ IP = J D-Iln2-^ (17) 

which coincides with the standard Ising result as expected, except for a trivial shift by 
D. At temperatures lower than the critical temperature defined by 

T c = (18) 

the IP state becomes unphysical, and the spin-glass phase has to take over. For any 
q < 1, the saddle-point equations yield the solution q = and the SG phase appears 
only at q — 1. Here, we have also x — 1 from the requirement X ^ Q- Then, the free 
energy takes the form 

f = D -l x -T* la2 - <19) 

The parameter x is determined by the extremal condition df /dx = as 

x = ^ = 2Tv / hT2. (20) 

J- c 

We obtain the SG phase solution as 



f SG = D- Vh^2, (21) 

where the zero spin state is irrelevant and the result is essentially the same as in the 
standard REM. 

The phase boundaries can be easily obtained analytically by equating the free 
energies of two respective phases. We get each phase boundary as follows. 

P-IP: 1 + 2e-? D = 2e-^ 2 /\ (22) 

IP-SG : T = T c , (23) 

P-SG: l + 2e-" D = 2e^ D+ ^. (24) 
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The resulting canonical phase diagram is drawn in figure QJi) with red lines. The SG 
phase exists at low temperatures for D < 2D C where 



(25) 



The P-SG transition for D c < D < 2D C is of first order. At D = D c , there is a tricritical 
point where the P, IP and SG phases meet. For D < D c , there is a first-order P-IP 
transition, whose transition temperature increases with decreasing D. The second-order 
IP-SG transition is at the critical temperature T c for any D < D c , thus regardless of 
the crystal field strength. As D — > — oo, the P-IP transition temperature diverges and 
we recover the standard REM result with only the IP and SG phases present. 

b) 




w 





p 




IP 


1 

£min 




D 



2D C l 



Figure 1. a) Phase diagram of the integer-spin REM in the (D, T)-plane. The 
canonical phase boundaries are drawn in red, and the microcanonical phase boundaries 
are overlaid in black for comparison. The canonical (microcanonical) phases are marked 
in red (black) letters. The red circle indicates the tricritical point and the second order 
IP-SG transitions line is the red dashed line, b) Microcanonical phase diagram in the 
(D, e)-plane. 



3.2. Microcanonical ensemble 

Similarly to the canonical case, the solutions of the microcanonical entropy can be 
calculated explicitly and we have 

sip = ln2- (e - £>) 2 , (26) 

sp = ±,n2- -£)m(i-£), P7) 

ssg = 0. (28) 

The phase diagram is determined by comparing these results, but in contrast to the 
canonical case, the higher entropy wins. Physics requires furthermore that the entropy 
is positive. We plot the entropy densities in the P (black) and IP (red) phases in figure [2j 
When the entropy reaches zero, the system freezes to the ground state and the SG phase 
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is realized (not shown). In each phase, the energy range is specified by 

IP : D - < e < D, (29) 

P : < e < \d (D > 0) and D < e < \d (D < 0), (30) 

SG : e = D - V)n2. (31) 

We note furthermore that in figure [2] the region where the respective entropies are stable 
are drawn in thick lines. 

The microcanonical phase diagram in the (D, e)-plane is shown in figure [Tb). In 
this case, the values that the energy density for each phase can take are limited, denoted 
by e min and e max respectively. We also see that the SG phase lies on a single line in the 
phase diagram, because it exists only for one value of the energy for a fixed D. For 
D < 2D C this is the e m i n -line. Therefore, the temperature 1/T = ds/de is not well 
defined in the SG-phase and has to be extrapolated from finite p-phase diagrams. 



D < < D < 2D C D > 2D C 




D 2D/3 2D/3 2D/3 e 

Figure 2. Entropy density s(e) in the IP (red) and P (black) phases. The equilibrium 
entropy follows bold parts. The leftmost panel shows the case for D < 0, as can be 
seen, the P phase reaches all temperatures in the interval [0, oo), while the IP phase 
exists in the range [T c ,oo) where both phases coexist. The middle panel shows a 
situation where there is a P-IP transition at finite temperature is realized, while the 
rightmost panel shows a situation where the IP phase is unstable. 

The ensemble inequivalence becomes apparent when we change the dependent 
variable from e to T according to relation ([6]) and thus transform the microcanonical 
phase diagram from the (D, e)-plane to the (D, T)-plane. The result is shown in 
figure [It) in black. We see that it is qualitatively different from the canonical result 
shown in the same figure in black. The IP-SG transition is of second order and that phase 
boundary coincides in both ensembles. The other boundaries are totally different from 
each other. With reference to figure |2] we see that there is no one-to-one correspondence 
between T and e for crystal-field strengths D < 2D C . There are regions such that two 
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values of e correspond to the same temperature. As a result, we have two coexistence 
phases P+IP and P+SG, as shown in figure [T^,). 

We find that the canonical and microcanonical phase diagrams are very different 
and it is hard to find common properties except the IP-SG boundary. We presume that 
one of the reasons for this discrepancy is the peculiarity of the p — > oo limit [231 El] ■ 
Therefore, we will study the finite-p case in the next section, to see how this deviations 
come about. 

4. Three-body interactions (p = 3) 

In this section, by solving the saddle-point equations with numerical help, we derive the 
phase diagrams of the Hamiltonian (TTJ) for p = 3. 

4-1. Phase diagram 

In the canonical ensemble, there is only a phase transition from the paramagnetic phase 
to the SG phase. We note that the IP phase appears only when the limit p — > oo is 
taken. We draw the phase diagram in figure [3^) in red. The transition is of second order 
for D < 0.724 and of first order until the SG-phase terminates at D = -De a ~ 0.84. 



a) b) 




Figure 3. a) Phase diagram in the (D,T)-plane with p = 3. The microcanonical 
phase boundaries are shown in black and the canonical in red. The black line with 
triangles is the AT line, b) Detail of a) denoted by the box with dashed edges. The 
red circle corresponds to the canonical multicritical point, where the P-SG transition 
goes from second order (left) to first order (right). The microcanonical multicritical 
point is at -Dmcp and is symbolized by a black square. 

In the microcanonical ensemble, the phase diagram in the (D, e)-plane is shown in 
figure H] and is summarized as follows. 

• D < D MC P ~ 0.737 

There is a second-order P-SG phase transition as in the canonical case. 
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Figure 4. Microcanonical phase diagram in the (D, e)-plane. e max and e m i n are the 
maximal and minimal attainable energies respectively. The red dashed line is the AT 
line. 



• £>mcp < D < A ~ 0.81 

In this the energy is lowered, we first observe a first-order transition in 

the paramagnetic phase. The order parameter \ jumps as depicted in figure Eh). 
The jump in x is at e = e 1 and is indicated by the black arrows in the figure. We 
denote this paramagnetic phase P*. As the energy decreases further, there is a 
phase transition from P* to SG at e = e . The P*-SG transition is of second order 
because at the transition point the Parisi breaking parameter is x — 1, guaranteeing 
a smooth change in the entropy. 

• D S <D < D MC « 0.92 

The phase P* becomes meta-stable for all accessible energies and does not appear. 
The P-SG transition is of first order. The order parameters are shown in figure [5b) 
for D = 0.83. 

• D > D MC 

In this case, there is no stable SG phase and we have only the P phase. 

When the energy is translated into temperature through the formula ([6]), we can 
draw the phase diagram in the (D, T)-plane as shown in figure [3] (black lines). Although 
the P-SG second-order transition line coincides, the other boundaries do not match. 
In the microcanonical calculation, the point where the transition changes from being 
second-order to first-order is D = -Dmcp ~ 0.737, while it is D f» 0.724 in the canonical. 
We also see that here the P* phase does not show up separately. Instead there are two 
regions where phases coexist: M=P+SG and M*=P+SG+P*. We will see in the next 
subsection how this result is obtained. 

4-2. Phase coexistence 

Let us now explain shortly, how the mixed phases appear in the (D, T)-plane (figure [3]), 
but not in the (D, e)-plane (figure BJ. We fix the external field at D = 0.77, so that all 




e 



Figure 5. Several branches of the saddle-point solutions of order parameters, a) For 
D = 0.745, there are two successive transitions. At e > e 1 , the system is in the P 
phase and the order parameter \ takes the lowest branch. It changes discontinuously 
at £ = e 1 as indicated by the two black arrows. At e 11 < e < e 1 , the system is still 
in a paramagnetic state, but labeled by P*. At e = e 11 the SG order parameter (red 
squares) jumps from zero (not shown) to a finite value, b) The same as a) but at 
D = 0.83. Here, the phase P* is meta-stable throughout and thus does not show up. 
The P-SG transition is of first order, accompanied by a jump in x and q, indicated by 
the black and red arrows. 



phases show up and plot the entropy versus the energy in figure Ek) . The corresponding 
caloric curve T(e) is shown in figure [6)3). At high energies e > e , the system is in the 
P state (black). As the energy is lowered, the temperature decreases as well. At some 
point the system develops meta-stable and unstable solutions. The meta-stable state 
corresponds to P* (blue), the unstable one has no physical meaning, but is plotted for 
the sake of completeness. At e = e 1 the entropies of the P and P* have the same value, 
but at the crossing point have different slopes, 
dsp 1 t \ , ds 



, (^^Me 1 )- (32) 
ae ae 

Therefore, the temperature jumps at the transition point, T 1 — > T*, as indicated by an 
arrow in figure [6b). Noteworthy is now that as the energy is lowered the temperature 
increases, corresponding to negative specific heat of the P* phase. At e = e , the 
system allows for a SG solution (green dashed) with q > 0. However, this SG-entropy 
connects smoothly to the P*-entropy, so that 

^V) = ^ (£ "), ,33, 

and there is no temperature jump. Thus, the transition is of second order, although 
the order parameter q jumps as indicated by figure [51 This is, as mentioned before, 
a consequence of the replica trick and the 1RSB parameter x guarantees a smooth 
transition. 

Mixed phases appear when we choose a temperature between, say T 11 and T*. At 
such a temperature, we can find stable solutions for every phase, giving rise to the M*- 
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mixed phase. The mixed phase M lies between T l and T*, and we can not distinguish 
the SG and the P phases. 
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Figure 6. a) Branches of the entropy versus energy per spin for p = 3 at D = 0.77: 
P (black), P* (blue) and SG (green dashed), b) The corresponding caloric curve. The 
phase transitions are at e 1 (P-P*) and at e n (P*-SG). 



4-3. AT condition 

In figure [3] and HI we plot the AT line, the boundary of the stability region. Below that 
line, the 1RSB solution of the SG phase is unstable and the full-step replica symmetry 



breaking solution has to be considered. We derive the AT condition in Appendix B 



As we have shown for the Ising system in [36], the conditions in both ensembles are 
essentially the same and are translated via the caloric relation ([6]). We confirm that this 
equivalence holds also in the present case. 



5. Many-body interactions (p > 3) 

For p = 3, the situation is still not very elucidating on how the infinite p limit is reached. 
Similarly to the case p = 3, the phase diagram can be obtained numerically for any p. 
Contrary to expectations, even p = 37 shows features different from p — > oo, but from 
figure [7] it is clear how that limit is achieved. 

As p grows, -Dmcp — > 0, D s — > and -Dmc — > 2D C , so that the mixed phase M*, 
along with P*, disappears completely as p — > oo. Simultaneously, the AT line drifts 
towards the e m i n -line, so that the 1RSB solution is stable everywhere. 

For infinite p, there is an IP phase, characterized by x — 1> which is not present for 
finite p. As the phase diagram in the limit, figure [lb), suggests, the SG phase off the 
e min -line, becomes the IP phase. It is because the SG order parameter satisfies q < 1 
there and such solution is inhibited in the limit p — > oo. We also infer that the M phase 
splits into two parts: P+IP for T > T c and P+SG for T < T c . 
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Figure 7. Microcanonical phase diagrams in the a) (D, T)-plane and b) (D, e)-plane 
for p = 37. 



6. Conclusions 

We have investigated an integer-spin SG model, where for finite p > 2 and a certain, 
p-dependent interval of the crystal-field strength D, the P-SG transition is of first order. 
This results in ensemble inequivalence along that phase transition. While the canonical 
phase boundary is a single line and the phases are cleanly separated in the plane with 
the temperature and the crystal-field strength as axes, various mixed phases appear 
there in the microcanonical analysis. This has far reaching consequences for the limit 
p — > oo, which corresponds to the integer-spin analogue of REM. There, the ensembles 
give completely different results for finite values of D, and coincide only in the Ising 
limit, D — > — oo, as expected. 

To the best of our knowledge, our analysis is the first that involves the SG 
transition and ensemble inequivalence, enriching that branch of statistical physics by 
another important facet. Furthermore, our result strengthens the point of view that the 
traditional REM shows ensemble inequivalence within the replica ansatz, which have to 
be contrasted to results that do not use the this method. 
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Appendix A. Replica analysis 



Here we give some technical details on the derivations of the generalized thermodynamic 
potentials ([3]) and (J4]). 
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Appendix A. 1. Canonical ensemble 

Following the standard strategy of the replica method [25j [26j |27], we can write the 
average of the nth power of the partition function Z in the canonical ensemble as 

n N ~| 

Era 2 ■ (a.i) 

a=l i=l ) 

This expression implies that we can introduce two kinds of order parameters Xa = 
(l/A0E*=i(^) 2 and q ab = (1/N) E^i Sf S%, with a ^ b. In the present case with 
integer spins, (S" 1 ) 2 is not unity, as in the Ising-spin case and 1 — Xa measures the 
fraction of the spins in the zero state. In the Ising limit D — > — oo, all spins take 
values S® = ±1, and therefore \a = 1- These order parameters are incorporated into 
the expression of the partition function by delta functions. This generalized Hubbard- 
Stratonovitch transformation gives us the expression 



[z n ] = J d X dq n s( Xa - ± E(^ a ) 2 ) n 6 U» - ^ e stsi 

a \ i / a^-b \ i 

x <*p ( E(xa) p + ?f E(^) P - Pd E (st) 2 



^ a * a <b 



f dxdqdxdq exp I E(Xa) p + E(<?afc) P 

■' ' 1 a<b 



-N E XaXa ~ N E Qabqab - N(3D E Xa + N In Tr e L } , (A.2) 

a a<6 a 



where 



L = E Xa^a + E VabSaSb- (A.3) 

The conjugate variables g and x are introduced to express the delta functions in their 
integral forms. They are related to the order parameters as 

Xa = ^PXT 1 ~ PD, (A.4) 

qab = —pq P ab 1 - (A.5) 

We impose the 1RSB ansatz for the order parameter q ab and the replica symmetric 
one for \ a . The 1RSB form of the SG order-parameter is 

!0 for a = b 
qi for [{a - l)/x\ = [{b - l)/x\ , (A.6) 
q otherwise 

where the Parisi breaking parameter x takes values between 1 and n, and \_z\ is the floor 
function giving the largest integer not exceeding z. When spin-reflection symmetry is 
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present, go is zero an d we can set q\ = q. Then, the spin sum in Tre L can be performed 
after a Gaussian insertion as follows, 



Tre L 



n / x f / 1 \ n r n ^ x Bx 1 

I] D^Trexp x-J E^ + V?E^ £ S A 

B=l J \ V Z J a=l B=l a=l+(B-l)x ) 

n/x . 

[] Dz B (l + 2e^ 2 cosh(^) 

D_ 1 J \ 



If Dz (l + 2e*-« /2 cosh(y^) Y , (A.7) 



where -Dz = dzexp(— z /2)/\/2ir. The generalized free energy is defined as 

P<j>= -lim-^ln[Z n ], (A.8) 
which then gives (J3]). 

Appendix A. 2. Microcanonical ensemble 

Next, we consider the microcanonical ensemble. The density of states for a given energy 
E is 

n = Tr 5{E - H) = ( — e ^ E - H ^. (A.9) 

Due to a formal similarity of this expression to the canonical partition function, we can 
apply the replica analysis to calculate the bond-average of the entropy S = [InO]. The 
calculation goes along the same lines as in the case of the Ising-spin system [23]. We 
find the expression 

I ab a 

-N^2qa b qab + N\nTie L \ , (A. 10) 

a<b ) 

where e = E/N and Q is an n x n symmetric matrix whose components are given by 

Q^\\ x 'l a Z b h - (A.11) 

{ {qab) p a to 
The conjugate variables are obtained from the equations 

Xa=pJ2^(Q- 1 )ba(Xa) P - 1 (Q- 1 )ace c + 2Dj2(Q- 1 )abe b , (A.12) 
be b 

q ab = 2pJ2^(Q' 1 )ca(qab) p ^(Q- 1 )b d e d , (A.13) 

cd 

where e a = e - Dx a 

We impose the same 1RSB ansatz as the canonical case to the order parameters. 
The conjugate variables are given by 

t-nT 1 -. p [f -- Dx) \ rX1 +2D ,'7/* , (A.14) 
{X p - (1 - x)qP} X p ~ (1 - x)q p 

U - Dy) 2 

q = 2pq p ~ 1 K - ^ 5 . (A.15) 
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Then, by taking the limit 

a = lim — ln[Q n ], (A. 16) 

we obtain (j3J). 

Appendix B. Derivation of the AT condition 

Appendix B.l. Expansion around the saddle-point solution 

In this part, the AT condition, the stability condition of a certain replica solution, is 
derived. We use the canonical ensemble to derive the condition, which can be easily 
translated into the microcanonical case. 

The starting point is equation ( IA.2j) . or rather its logarithm as 



n/30= ~^HZ n ] (B.l) 

(3 2 (3 2 

= ~ -J YiXaY - — Y^Y + Y XaXa + Y ^ab + f3D^Xa 
a Z a <b a a <b a 

-lnTre L , (B.2) 
where L is given in ( 1A.3I) . Then, we consider variations of the form 

Xa~>Xa + 5Xa, (B.3) 
qab -> qab + Sq a b, (B.4) 

and accordingly, is expanded as = / + <50 + <5 2 + • • •. We shall impose some solution 
of the free energy at the zeroth order of this expansion. Since the saddle-point method 
is used in the derivation of the free energy, the first order of the variation is equal to 
zero, 5(f) = 0. The second-order term reads 

f3 n 5 2 4> = ^Y SXahXa + \Y SqabSiqab 

1 a 1 a <b 

~ \ J2Y 6 lXa 6 lXb ((SlS 2 ) ~ XaXb 



~ Y Y $iXa5iqbc ((SlS b S c ) - Xaqbc 

l b<c 

Y Y Siqabhqcd ((S a S b S c S d ) - q ab q cd ) , (B.5) 



a b<c 
1 

2 



a<b c<d 



where 



and 



N _ Tr(---)e^ 

( -" } - Tre^ ' (R6) 



SiXa = ^ P (p - l)xr 2 5Xa, (B.7) 

(3 2 

$iq a b = yP(p - l)q P a b 2 5q ab . (B.8) 
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Arranging the n elements of 5\ a and the n(n — l)/2 elements of 5q ab into a single 
vector 

5(i T = ($Xi, • " " , $Xn, Squ, • ■ ■ , dgn-i,n), (B.9) 

we can define a diagonal matrix T which transforms 5(i into which has 5\ a and 5g a fe 
as elements: 

5(1 = T5(i. (B.10) 
Then, we can write 

(3n6 2 = ^5(i T (T - TGT)5(i, (B.ll) 



where the elements of the matrix G can be inferred from (1B.5|) . The stability condition 



is expressed by equations that the eigenvalues of the Hessian matrix T — TGT are 
nonnegative. 

Appendix B.2. Stability of the 1RSB solution 

We impose the replica symmetric solution for Xa as Xa = X an d the 1RSB solution for 
q ab as (1A.6j) with q = 0, qi = q. 



The eigenvalues are calculated as the standard case [26]. The relevant part of the 
matrix G is components 5q a b with [(a — l)/x\ = \_(b — l)/x\. In this block, we have 
three types of the matrix elements: 

P = G {ab){ab) =v-q\ (B.12) 
Q = G(ab)(ac) = w - q 2 , (B.13) 
R = G {ab)(cd) = r - q 2 , (B.14) 

where the index denoted as (ab) represents the component 5q ab and different symbols 
are assumed to be unequal. In these expressions, the spin sums denoted as v, w and r 
are calculated as follows. 

Q „ r |2e*-^ 2 cosh(^)} 2 

v = ((S a ) 2 (S b ) 2 ) = / \ 2 , (B.15) 

J {l + 2eX-?/2 C osh(V9^)} 

f 2e^-^cosh(^){2e^^sinh(^)} 2 

w = (S a S b S c ) = / L> z ^ -3 (B.16) 

J [1 + 2e*-'?/ 2 cosh( x /gz)} 

(2 e x-9/2 sin h(^)\ 4 

r = (S a S fc S c S d > = / D's-i i— j. (B.17) 

J [1 + 2e*-'?/ 2 cosh( x /g2)} 

Here, the integral measure is defined as in equation (fl3l) . 

The stability condition is analogous to the half-integer case, where only one 
eigenvalue of the Hessian can be negative. The other eigenvalues correspond to 
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extremization conditions of the free energy and are, therefore, positive by construction. 
We have the stability condition 

2 - (P-2Q + R) > 0, (B.18) 



f3 2 p(p - l)qP~ 2 

where the first term on the left hand side comes from the inverse of the corresponding 
component of T and can be extracted from (IB. 81) . We finally obtain the AT condition 
in the canonical ensemble 

2 > r D , \{2e*-^Y + 2e^' 2 cosh(^)} 2 

p{p - 1)/3V" 2 " J Z {l + 2e*-9/2 cosh (^)} 4 ' 1 ' ' ' 

where the conjugate variables are given by (1A.4I) and (1A.5j) . 

It is straightforward to convert the canonical result into the microcanonical one 
using the relation (JH]), 



{x p _ (i _ x ) qP} 2 > , {(2e*-«/ 2 ) 2 + 2e*-V 2 cosh(^qz)} 



2 



2p(p- l)qP 2 (e-D X ) 2 J " |i + 2e x-?/2 C osh(^)} 

(B.20) 

where the conjugate variables are given by (IA.14I) and (IA.15I) . 
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